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0 Interactive patient assistance system. 



© A system is provided for interactively assisting a patient. The system includes a speech synthesizer and 
recognition unit coupled to a programmed computer. The computer can keep track of a medication and 
diagnostic testing schedule. The system also includes diagnostic testing equipment coupled to the computer 
along with medication dispensing equipment. In accordance with a predetermined schedule, the system verbally 
communicates with the patient, prompts the patient through the various steps necessary to carry out the 
diagnostic testing and further prompts patient at appropriate times for taking medication. The medication is also 
^provided in combination with the verbal prompts. The system also provides access to a telecommunications link 
^in response to verbal requests of the patient and in one embodiment can move in a limited area adjacent the 



O) patient. 
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MULTI-CONTAINER INTERACTIVE SYSTEM 

Reference to Related Patent Application 

The present patent application is a continuation-in-part of patent application Serial No. 194,018 filed 
May 12, 1988 entitled INDIVIDUAL ASSISTANCE SYSTEM and assigned to the same assignee as the 
5 present application. 

Field of the Invention 

;o The invention pertains to apparatus and devices for assisting individuals. More particularly, the invention 
pertains to a computer based system for providing at home or institutional assistance to a convalescing or 
injured patient. 



75 Background of the Invention 

Over the last several years, there has been a substantial shortening of the period of time patients 
remain in hospitals. Reductions in hospital stays are directly related to the Federal Medicare Regulations 
governing reimbursements to hospitals and other institutions. These regulations impose strict limits on the 
20 number of hospital days, or institution days, for which Medicare will reimburse the hospital or institution. 

Due to the shortened hospital stays, many patients are returning home in a debilitated or partially 
recovered condition. These patients often need assistance or reminders that medication should be taken, or 
that various measurements such as temperature or blood pressure should be made. 

This situation is exacerbated by the fact that the size of the population which is over 65 years of age is 
25 continually increasing and will be increasing for the foreseeable furture. In addition, because of the 
improved health care delivery system in general, patients with chronic diseases are surviving for longer 
periods of time and leading relatively normal lives with intermittent outpatient intervention. 

It has also been recognized that patients who need follow-up or who are convalescing at home can 
benefit from regular home monitoring. Such monitoring provides follow up information concerning the 
30 condition of the patient. 

For instance, home monitoring can provide information concerning the long-term effectiveness of drugs. 
This information can in turn lead to altering, increasing or decreasing prescription requirements to more 
cost effectively obtain the desired result with the patient. 

Home monitoring can also provide long-term trend information concerning patient vital signs. In extreme 
35 cases, home monitoring can result in immediate intervention to avoid a life threatening situation. 

Thus, there continues to be a need for devices and apparatus which would be of assistance to 
homebound patients in a variety of ways. Further, there continues to be a need for such devices which can 
be provided cost-effectively. 

40 

Summary of the Invention 

In accordance with the invention, a patient assistance system is provided for repetitively interacting with 
an individual in need of assistance. The system can provide a variety of functions useful to an individual 
45 who may be debilitated or convalescing from an injury or an illness. 

The system includes a control unit which can provide a variety of patient support functions. A 
programmable clock/calendar readout is coupled to the control unit. The clock/calendar unit can be 
programmed to perform reminder functions at predetermined times. For example, the clock/calendar unit 
can provide a wake-up alarm, can regulate medication dispensing, or can keep track of times at which tests 
so should be carried out. 

An audible alarm or visual indicator can be provided as a reminder of when an activity should be 
commenced. The audible alarm can also be used to introduce an audible synthesized message. 

The system also includes voice synthesizer circuitry for the purpose of generating audible messages. 
The messages can remind the patient of specific, preprogrammed, tasks to be performed at predetermined 
times. For example, the voice synthesizer circuitry, in combination with the control unit, can remind the 
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patient that it is time to take medication or carry out a monitoring test such as taking a temperature or a 
blood pressure. 

The voice synthesizer circuitry can also be used to communicate with the patient when the preprogram- 
med schedule needs to be varied. That circuitry can also prompt verbal responses usable to determine 
s general patient condition. 

Speech detection circuitry can be used to analyze those responses or requests. That circuitry can then 
signal the control unit with an identification of those responses. 

The voice recognition and synthesis circuitry can be used to verify, via audio feedback from the patient 
that certain tasks have been successfully performed. These include taking medication or conducting various 
70 tests. 

As an alternate, a keyboard could be used for operator input instead of voice recognition circuitry. 
Instead of a keyboard a touch-sensitive ...screen can be used. 

The system can also include sound and motion detecting systems. The sound detection system, 
coupled to the control unit, can detect ultrasonic transmissions from a patient transmitter such as a 
75 medallion or a wrist transmitter. The sound detection system can also detect and enable the control system 
to respond to requests by the patient for assistance. 

A moveable embodiment of the system includes an ultrasonic collision avoidance system. The 
ultrasonic system can determine distance, range and proximity of objects for collision avoidance purposes. 
Further, the ultrasonic system enables the patient assistance system to move within a specified region near 
20 the patient to provide for easy accessibility thereto. 

The system can also include an interface between the control unit and a telephone. In response to 
commands from the control unit, the interface can provide for automatic dialing in response to patient 
requests or in response to detected emergency conditions. 

The system also includes a printer for generating a hard copy record of daily medical information 
25 including test results as well as delivery of medication. A recording system can store that information in 
machine readable form. 

A modem is coupled to the automatic dialer in the interface. The modem can be used for the purpose 
of communicating with a remote medical computer, for transferring patient information to the remote 
computer or for receiving programmed instructions or information from the remote computer. 
30 Further in accordance with the invention, a method of interacting with a care requiring individual is 
provided. The method includes the steps of: 
detecting audio emergency requests for help from the individual; . 
detecting when the individual should receive predetermined medication; 

making the predetermined medications available to the individual in accordance with a predetermined 
35 schedule; 

verifying that the predetermined medications have been received by the individual; 

recording electronically the fact that the medications have been provided as well as the fact that an indicium 
has been received that the medications were received by the individual; 

reminding the individual to carry out certain predetermined monitoring tests at predetermined time intervals; 
40 recording electronically results of the predetermined tests; 

automatically dialing a predetermined number to establish a communication link with a remote information 
receiving unit; and 

transferring the results of the monitoring test step to the remote unit. 

Numerous other advantages and features of the present invention will become readily apparent from the 
45 following detailed description of the invention and the embodiments thereof, from the claims and from the 
accompanying drawings in which the details of the invention are fully and completely disclosed as a part of 
this specification. 

so Brief Description of the Drawings 

Figure 1 is a perspective view of a stationary recordkeeping and medication delivery interactive 
system in accordance with the present invention; 

Figure 2 is a perspective view of a moveable recordkeeping and medication delivery interactive 
55 system in accordance with the present invention; 

Figure 3 is a block diagram schematic of an electronic system in accordance with the present 
invention. 



3 



BNSDOCID: <EP 0342859A2J_> 



EF 0 342 859 A2 



Figure 4 is an overall perspective view of a system in accordance with the present invention 
interacting with a patient; 

Figure 5 is a fragmentary perspective view of the system of Figure 4 supported on a powered 
module for movement; 
5 Figure 6 is a rear elevational view of the system of Figure 4; 

Figure 7 is an enlarged fragmentary view in perspective of a portion of the thermometer 
storage/delivery unit 

Figure 8 is an enlarged fragmentary view in perspective of a portion of the product storage/delivery 

unit; 

io Figure 9 is an enlarged fragmentary view in perspective, partly broken away, of the actuating 

mechanism of the storage/delivery unit of Figure 7; 

Figure 10a is a view in section illustrating a first or inactive state of the product dispensing 
mechanism; 

.Figure 10b is a view in section of the product dispensing mechanism in a second or dispensing state; 
;s Figures 11a-11e ( taken together, are a flow diagram of the software and interactions of the system of 

Figure 4; 

Figure 12 is an overall block diagram -schematic of the electronic control system of the system of 
Figure 4; 

Figure 13 is a detailed electronic schematic of a portion of the interface circuitry of the system of 
20 Figure 4; and 

Figures 14a and 14b, taken together, are a detailed electronic schematic of another portion of the 
interface circuitry of the system of Figure 4. 



25 Detailed Description of the Preferred Embodiments 

While this invention is susceptible of embodiment in many different forms, there are shown in the 
drawing and will be described herein in detail specific embodiments thereof with the understanding that the 
present disclosure is to be considered as an exemplification of the principles of the invention and is not 
30 intended to limit the invention to the specific embodiments illustrated. 

Figure 1 is a perspective view of a patient assisting system 10 in accordance with the present invention. 
The system 10 includes a housing 12. carried by the housing 12 is a video display unit 14. 

The system 10 includes a clock/calendar unit 16. The clock/calendar unit 16 can be a digital unit with 
an integrally formed display. 

35 The housing 12 carries an audible alarm 16a. The audible alarm 16a can be actuated by the electronic 
clock/calendar unit 16. The clock/calendar unit can be a programmable unit in which a schedule can be 
established to identify a variety of scheduled activities during a 24-hour interval. A display 16b is also 
coupled to the clock/calendar unit 16. 

The housing 12 also carries a hard copy printer 18 capable of generating hard copy 20. The copy 20 

40 can include information pertaining to medication schedules, delivered medication, test results or instructions 
as may be desired. 

The system 10 can also include a blood pressure monitoring cuff storeable in a region 24 of the system 
10. The same cuff can be used for pulse rate detection as well. 

The system 10 can also include a thermometer 28 coupled thereto. The thermometer 28 can be drawn 
45 from the system 10 and used by the patient to provide an indication of corporal body temperature. The 
thermometer 28, the blood pressure cuff and the pulse rate sensor can be' used to provide feedback to the 
system 10 concerning patient related characteristics. Temperature and blood pressure measurement values 
can be displayed using readouts 29. 

The system 10 also includes a pharmaceutical dispenser 30. The pharmaceutical dispenser 30 can 
so under control of the system 10 dispense medication on a strip 32 in accordance with a schedule maintained 
by the programmable clock/calendar unit 16. 

The medication on the strip 32 can be dispensed in combination with either a printed reminder which 
can be printed by the printer 18 on the strip 20 or in combination with a verbal reminder. A voice 
synthesizer and recognition unit 36 carried by the housing 12 can provide audio reminders to the patient 
55 that a scheduled time for taking a medication has arrived. The unit 36 can provide audible feedback from 
the patient to the syste 10. 

For example, the voice synthesizer and recognition unit 36 can detect statements made by the patient 
requesting assistance. These statements can include requests for help if the patient is in need of outside 

4 

BNSDOC1D: <EP 0342B59A2J_> 



EP 0 342 859 A2 



assistance. Alternately, the voice synthesizer and recognition unit 36 can detect requests by the patient to 
display information on the display 14 or to provide the appropriate medication. Finally, the voice synthesizer 
and recognition unit 36 can be used by the patient to establish the schedule to be maintained by the 
programmable clock/calendar unit 16. 

s It will be understood that in addition to detecting blood pressure, heart rate and body temperature, the 
system 10 could provide facilities for detecting blood gas levels as well as carrying out other types of non- 
invasive diagnostic tests. For example, one type of diagnostic testing that can be carried out in connection 
with the system 10 make use of known oximetry probes. Such probes can be attached to the ear lobe or 
finger of the patient and provide for continuous or intermittant reading of oxygen saturation levels in the 

ro blood. 

The system 10 aiso incorporates a modem 40 which can be utilized in combination with an automatic 
dialer unit 42. The modem 40 could incorporate a standard type of telephone handset 44 rf desired. By 
incorporating a handset 44, the system 10 can provide for a voice communication between the patient and 
a remote location. 

75 • By means of the modem 40, the system 10 can communicate with a remote medical center over the 
telephone system. Information which has been accummulated in the system 10 concerning patient activity 
or the results of diagnostic testing can be automatically transmitted via the modem 40 and the telephone 
system to a remote medical center computer for analysis. The results of such analysis can be used to 
determine whether or not further intervention, such as changing the medication schedule or the type of 
20 medication, is desirable. 

The system 10 can also include a magnetic recording system. The recording system can record, on a 
relatively long-term basis, results of diagnostic tests, information concerning patient activity, dispensed 
medication and any other information of value in improving the quality of patient care. 

The various elements of the system 10 function with a control unit 46. The control unit 46 could include 
25 a programmed computer. 

Figure 2 illustrates a perspective view of an alternate embodiment 50 of the system 10. The system 50 
includes many of the functions and capabilities previously described with respect to the system 10. Such 
elements are identified using the same identification numerals as were used with respect to the system 10. 
In addition, the system 50 provides additional capabilities and functions not present in the system 10. 
30 The system 50 in contradistinction to the system 10 is moveable under the command of the internal 
programmed control computer 46. The moveability of system 50 permits it to move toward the bedside or 
chair of the patient for ease of interaction with the patient. 

Control over the movement of the system 50 by the computer 46 is effected by an ultrasonic system 
52. The ultrasonic system 52 includes both a transmitter and a receiver 52a and 52b respectively. The 
35 ultrasonic system 52 can detect transmission from a patient-carried transmitter. The patient-carried 
transmitter can be used to inform the system 50 of the location of the patient. It can aiso be used to detect 
whether or not the patient is ambulatory and whether or not the patient has had an accident and has fallen 
and is in need of additional assistance. 

The ultrasonic system 52 can also determine distance, range and proximity to objects for the purpose 
40 of collision avoidance. The ultrasonic system 52 also permits the patient assisting system 50 to safely move 
within a specified range near the patient. 

The system 50 aiso includes a nasal cannula 54 usable in connection with administering oxygen 
therapy. Further, the system 50 can also include a probe 56 for measuring saturated oxygen levels in the 
blood, as previously discussed. Such probes, such as 56, are noninvasive and can readily be affixed by the 
45 . patient to the appropriate corporal member. 

The system 50 also includes a digital blood pressure sensing cuff 60 which can be removed from the 
storage region 24. The patient can apply the cuff 60 to an arm or finger or any other appendage. Under 
control of the system 50, the cuff 60 can be automatically inflated, the results of the blood pressure 
measurement can be detected by means of the monitoring function input interface 48. The cuff 60 can then 
so be deflated and removed by the patient for storage in the region 24. 

Simultaneously with detecting blood pressure by means of the cuff 60, the patient's pulse rate can also 
be detected. 

The system 50 includes the voice synthesis and recognition unit 36 which provides an audio 
communication and control path between the patient and the system 50. A battery 64 is carried within the 
55 housing 50a for the purpose of powering the unit 50. The battery 64 can be a rechargeable type which can 
be recharged during periods of patient inactivity, such as night. 

If desired, the handset 44 can be of the cordless type. In this instance, the system 50 would also carry 
a transmission/reception antenna 66. 

5 



BNSDOCID: <EP 0342859A2_I_> 



EP 0 342 859 A2 



It will be understood that the system 50 functions at ail times under the control of the programmable 
unit 46 to insure proper carrying out of the above described functions. Further, by means of the voice 
synthesis and recognition unit 36 the patient is always able to provide verbal commands to the unit 50. 

Further in accordance with the invention, Figure 4 illustrates as an alternate embodiment, a system 1 00 
5 in accordance with the principles of the present invention. The system 100 is being utilized by a patient P 
for purposes of carrying out a diagnostic test Many of the elements of the system 100 correspond to 
elements of the system 10 and the system 50. Corresponding elements have been identified with the same 
identification numerals as were used in Figures 1 and 2. 

The system 100 includes a housing 102. The housing 102, at an upper surface 102a. can support an 
10 optional display unit 14, indicated in phantom. The housing 102 also carries an alphanumeric display 104. 
The alphanumeric display 104 can be used to conveniently display the results of various diagnostic tests 
which can be performed by the system 1 00. 

In particular, the system 100 is illustrated in Figure 4 with the patient P using a finger type blood 
pressure and pulse rate cuff 106. The cuff 106 can be used to detect the blood pressure and pulse rate of 
75 the patient P. 

Supported on an upper surface 108 of the housing 102 is a telephone corresponding to the telephone 
44. It will be understood that a variety of different telephones can be used without departing from the spirit 
and scope of the present invention. 

Also carried on the surface 108 is a loudspeaker 110 which is coupled to the voice synthesis and 
20 recognition unit 36 discussed previously. A hands-free microphone 112 is also provided, coupled to the 
voice synthesis and recognition unit 36, for purposes of audio input by the patient P. 

The housing 102 also supports a plurality of visual indicators 120a, 120b and 120c. The indicators 120a, 
120b and 120c are usable in conjunction with a plurality of moveable storage/delivery units 124a, 124b and 
124c. 

25 The storage/delivery units 124a, 124b and 124c can be used for storage and delivery of a plurality of 
different items. For example, the unit 124a is illustrated in the system 100 as being the storage/delivery unit 
for the finger type cuff 106. The indicator 120a is utilized to prompt the patient P to the fact that the unit 
124a has been released and the cuff 106 should be removed therefrom and inserted on the patient's finger 
for purposes of conducting a diagnostic test. 

ao The unit 124b can be used for storage and delivery of a thermometer. The unit 124c can be used for 
storage and delivery of prescheduled products. The products can include medications in either liquid or 
solid form. 

It will be understood that the types of apparatus and/or products, described above, utilized with the 
units 124a, 124b and 124c are merely exemplary. The exact type of apparatus stored or product delivered 
35 is. not a limitation of the present invention. 

The housing 102 also carries a manually operable, illuminatable signaling button or switch 126. The 
button or switch 126 can be used by the patient P to inform the system 100 that various activities have 
taken place or that various conditions have been met. 

For example, the button or switch 1 26 can be used to prompt the system 1 00 to the fact that the patient 
40 has placed the cuff 106 on a finger and is ready for a blood pressure measurement to be made. Similarly, 
the switch 126 can be used to prompt the system 100 to the fact that the thermometer has been properly 
positioned and a temperature reading can be made. Finally, the button or switch 126 can be used to prompt 
the system 100 to the fact that a product, such as a medication, has been removed from the unit 126 and 
has been taken by the patient P. 
45 While the system 100 has been illustrated in Figure 4, supported on a plurality of rollable casters 130, it 
will be understood that, in accordance with the embodiment previously discussed in Figure 2, the system 
1 00 could be provided with a motorized unit for purposes of movement. 

Figure. 5 illustrates an exemplary motorized unit 132. The unit 132 carries the housing 102. The unit 132 
includes a motor, control electronics and power source 134. The unit 134 can be mechanically coupled to 
so drive wheels 136 for the purpose of moving the system 100 toward or away from the patient P. 

Figure 6 is a view of the rear of the housing 102 illustrating various components of the system 100. The 
housing 102 defines an interior region 140 wherein the components of the system 100 are carried. 

The system 100, as discussed previously with respect to Figures 1 and 2 includes a programmable 
control computer 46. The computer 46 can be of a type comparable to IBM R -PC-XT or other computer 
55 system capable of performing multi-tasking. The unit 46 can include an interface for driving the display 14, 
if present by the system 100. The unit 46 can also include the programmable clock/calendar unit 16. 
The unit 46 can also include a disc drive controller. 

Disc storage 142 can be located within the housing 102 adjacent the computer 46. The disc storage 
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184a. 

As illustrated in Figure 10B t the index plate 180 can be moved laterally in a direction 180a in response 
to the control unit 46 actuating an electrical solenoid. The movement of the indexing unit 1 80 dispenses the 
product M1 located in the region 182 as illustrated in Figure 10B. At the same time, movement of the 
s indexing plate 180 blocks other products M in the region 174a from being dispensed simultaneously. The 
product M1 when released from the indexing member 180 can slide down the delivery shut 180a and into 
the unit 124c for subsequent removal and use by the patient P. 

At the end of the release cycle the indexing unit 180 returns to its rest position illustrated in Figure 10A 
by moving opposite to the direction 180a. The cycle may then be repeated. The next time the solenoid is 
70 energized, the index unit 180 will again move in the direction 180a and dispense a single product to the unit 
124c. 

It will be understood that the exact structure of the dispensing mechanism 124b is not a limitation of the 
present invention. Nor, is the type of product to be dispensed a limitation of the present invention. 

Figures 11 A through 11E, taken together, are a flow diagram illustrating the steps of a method of 
75 operation of the system 100 and its interactions with the patient P. the flow diagram of Figures 11A-11E 
also defines the control program to be used with the control computer 46 to implement the functioning of 
the system 100. 

Attached hereto as an Addendum is a listing of a program usable with the system 100. The first group 

of instruction, up to line 400 of the Addendum, is a plurality of interface sub-routines to enable the 
20 processor 46 to interact with various of the interface devices. The portion of the program from line 400 on to 

the end is written in BASIC and is the control program for the system 100. 

Figure 12 is a block diagram schematic of the system 100. As noted previously, the processor 46 or 

central processing unit is comparable to an IBM R -PC-XT class computer. The power supply 144 coupled 

thereto is of an uninterruptable type having a self-contained rechargeable battery. 
25 The processor 46 is coupled via an address bus 200 and a data bus 202 to a plurality of input/output 

units. Among those units is a modem 40a which includes automatic dial and answer as well as a voice 

channel for audio communication. 

The address bus 200 and data bus 202 are also coupled to solenoid drive circuitry, indicator drive 

circuitry and medication solenoid drive circuitry 48a. The address bus 200 and the data bus 202 are also 
30 coupled to instrumentation interface circuitry 48b. The instrumentation interface circuitry can include the 

blood pressure/pulse rate cuff 106 thermometer 152, along with optional blood gas analyzer 56 and urine 

analyzer. 

The speech processor circuitry including the voice synthesis/recognition unit 36 as well as voice 
recorded circuitry is also coupled to both the address bus 200 and the data bus 202. The system 1 00 also 
35 utilizes a 10 megabyte hard disc and a 360 K-byte floppy disc represented by element 142. If desired, the 
optional display 1 4 will also be coupled to the address bus 200 and the data bus 202. 

The display 14 could also include a keyboard for operator input. Instead of a keyboard, the display 14 
could incorporate a touch sensitive screen. 

Finally, the system 100 includes 512 K-bytes of main random access memory 206 which utilizes the 
40 available battery backup. 

Figure 13 is a detailed schematic diagram of the interface circuitry 148 between the cuff 106 and the 
data bus 202. Acoustic signals from the cuff 106 are detected in a condenser microphone 208. The 
condenser microphone 208 serves as the electrical input to the circuitry 148. Signals from the microphone 
208 are processed in the circuitry of Figure 1 3 and coupled to the data bus 202. 
45 Figures 14A and 14B, taken together, are a detailed schematic of the driver circuitry 48a. 

Elements U1 f U2 and U3 are LM3302 type comparators. Elements U4, U5 and U6 are operational 
amplifiers type LM324. Signals from the address bus 200 and the data bus 202 are received at inputs to the 
plurality of comparators 210. Outputs from the comparators 210 provide inputs to a plurality of operational 
amplifiers 212. 

so Outputs through the operational amplifiers 212, via a plurality of transistor drive circuits 214 provide 
electrical signals and power levels for an 8-voit regulated supply 216 to power the circuitry for the blood 
pressure cuff 106, and to illuminate indicators 120a, 120b, 120c and 126a. The drive transistors 214 also 
provide signals to actuate a cuff venting solenoid 220, a cuff drawer releasing solenoid 222; a thermometer 
drawer releasing solenoid 224; a dispensed product drawer releasing solenoid 226 and a product dispens- 

55 ing mechanism actuating solenoid 228. 

The principles of the present invention, it will be understood, are applicable to computer based 
systems, with or without speech recognition, usable by persons of good health and sound body. Further, it 
will be understood that systems in accordance with the present invention can also be used in hospitals or 
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nursing homes. 

From the foregoing, it will be observed that numerous variations and modifications may be effected 
without departing from the spirit and scope of the novel concept of the invention. It is to be understood that 
no limitation with respect to the specific apparatus illustrated herein is intended or should be inferred. It is t 
of course, intended to cover by the appended claims all such modifications as fall within the scope of the 
claims. 



2 '* * 

4 '* # ADDENDUM * 

5 '* * 

6 >* * 

7 '* MARCH 1988 * 

8 '******★***********************#*********#*****#******************** 

9 GOTO 560 

10 ADC ♦ SETUP-&H9 IB : ALTOUT12 . B~fiH7 3 8 s ALTOOT12 . B3V &H7 9 9 : ALTOUT12 . R-6H7FD 
2 0 ALTOUT12 . WV4H8 6 0 : ALTOUT12 . S- 4H6E5 : ALTOUT12 . ST-&H7 OD : ALTOUT8 . B-&H2A9 
3 0 ALTOUT8 • BT-&H3 3 5 : ALTOUT8 . R-&H3 C7 : ALTOUT8 »RT»fcH4 59 : ALTOUT8 . S*«i2 2 0 

4 0 A.LTOUT8 . ST»tH262 : DAC. SETUP- £H1A : INADC12 . B~&HD5E: INADC12 .BT-&HDF1 
50 INADC12 . EXTCLOCX«fcHE94 : INADC12 . S«"&HCE5 : IHADC12 . ST-&HD16 : INADC8 . B»&H9C3 
60 INADCB.BT-&HA31: IKADC8 . EXTCLOCX* tHAA2 : INADCB .S-6H93E : INADCB .ST-&H974 
G OUTDAC12 . B-feH550 : 0UTDAC12. BT-4H5B5 : OUTDAC12 . R-&H61D : OUTDAC12 . RT-&H67 6 
6 V OUTDAC12 - S-6H4 Fl : OUTDAC12 . SSV6H5 IF : OUTDAC8 . B-&H9 2 : OUTDAC8 . BT-&HF3 

68 OUTDAC8 . R-&H157 : OUTDACS . RT-fiHlBA: OUTDAC8 . S-&H3F : OUTDACS -ST-fiH67 

69 SCAN 12 . B-&HFFD : SCAN 12 . BT»fiH1095 : SCAN 12 . S=&HF4 3 : SCAH12 . ST=&HF97 

70 SCAN8.B-&HBBD:SCAN8,BT-&HC4E:SCAN8.S*&HAFF:5CAS8.ST=iHB54 
80 DEF SEG-0 

85 CSEG«(256*PEEK(MI3CB))+PEEK(4H3CA) 

90 DEF SEG-CSEG 

91 ' 

92 * 

93 ' 

94 ' 

95 ' 

96 ' 

97 ' 

98 ' 

99 ' 

100 '****•***********»***★**************************************************** 
210 ADDRESS *-&H3 00 'module address 

; ) CALL ADC. SETUP (ADDRESS* ) 'setup address 

230 DIM ARRAY* (1000) 

235 GOTO 560 

236 'ANALOG BOARD SUB ******************* 

240 BCHANNEL*-0 'beginning channel 

250 ECHANNEL*«4 ' end channel 

2 60 TMING*«1000 'around 5jbs 

27 0 LENGTH*" 1 '1 PASS SCAN 

280 SCANNO*«EC3»NNEL*-BCHANNEL*+l 

290 CALL SCANS . B (BCHANNEL* r E CHANNEL* , TIMING* , LENGTH* , ARRAY* ( 1 ) ) 
300 ' 

310 PRINT "CHANNEL 0 CHANNEL 1 CHANNEL 2 CHANNEL 3 CHANNEL 4* 

320 PRINT 

330 FOR 1-1 TO LENGTH* *S CANNO* STEP SCANNO* 

340 PRINT ARRAY* (I) , ARRAY* ( 1+1 ), ARRAY* (1+2) , ARRAY* (1+3) , ARRAY* (1+4) 

350 LET V~ARRAY*(I) 

360 LET W-ARRAY*(I+1) 

370 LET X-ARRAY*(I+2) 

380 LET Y«ARRAY*(I+3) 

390 LET Z«ARRAY*(I+4) 

399 NEXT 

400 RETURN 'END OF ANALOG SUB ***************** 
410 ' 

420 ' 

500 'CHECK TIME ROUTINE 
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510 DT*=2 ***** **** **** **** " ww 

520 T*-VAL(MID$(TIME$,4,2) )+DT* 
530 IF T*«>60 THEN T%«T*-60 

540 IF VAL(MID$ (TIMES, 4,2 ))«T* THEN 550 ELSE 540 
545 GOTO 590 

550 ' 

560 SRT*«INP(H301) 'PUSH BUTTON TO START 

70 570 IF SRT%<«1 THEN GOTO 600 ELSE GOTO 560 

580 ' 

590 'SETUP & DATA **** **** **** **** **** 



75 



35 



605 OUT *H30B,&H89 'WAKEOP 8255 AND CONFIG PORTS A&B OUT C IN/OUT 

606 OUT &H309,tHF 

610 COUNT-10 00 :COUNT2»3 00 0:REPS-2: PRESSED*" 1 

620 HOSP«3663:HARY=0663:DOC-3663 '*****PHONE NUMBERS****** 

0 FLAG 1—0 : FLAG2=0 : FLAG 3=0 : FLAG 4—0 : FLAG 5™ 0 : FLAG6-0 : FLAG 7^*0 : FLAG 8 ="0 
640 SYSLO-100:SYSHI-150:DILO-6O:DIHI-90 'BLOOD PRESSURE LIMITS 
650 FULSLO=60:FULSHI«110 'PULSE LIMITS 
660 THIGH-100:TL0W-96.5 'TEMPERATURE LIMITS 
670 FULS=80:BPS-90:BPD*60:TEMP*»98.6 'TEST DATA 
680 OPEN "TISFCH" ' FOR OUTPUT AS #1: PRINT # 1 , "RESET" 
» n 690 PRINT #1, "V0LUME-8" 

700 PRINT #1, "LOAD-NAME" 

709 PRINT #1, "RECOGNIZE-ON" 

710 PRINT #1, "RECOGNIZE=NAM£" 

711 PRINT n, »SPEAKFILE«WHO.MSG" m _ 

712 FOR L*l TO COUNT: WH0$=INKEY$ : IF WHO$<>" n THEN 713 ELSE NEXT L 

713 IF WHO$«»l» THEN PRINT #1, "L0AD=MIKE« : PRINT #1, "RECOGNIZ^MI^" : RELLO$=^ 

714 IF WHO$-»2» THEN PRINT #1, "LOAD-TAM" : PRINT #1, "RECOGNIZEE": HELLO$="TA> 
25 715 IF WHO$«»3" THEN PRINT #1, "LOAD-STEV" : PRINT #1, "RECOGNIZE=STEV" : HELLO $="£ 

720 GOTO 711 ' NAME NOT RECOGNIZED 

725 ***** **★* **** **** **** **** **** **** **** **** **** **** 

730 ' WAKEUP CALL 

731 PRINT HELLO $ 
0 LOOP-0 

750 FOR I«500 TO 1000 STEP 250: SOUND 1, 9: NEXT I 
30 755 H0UR1»VAL(LEFT$(TIME$,2)) :MIN1=»VAL(MID$ (TIMES , 4 , 2) ) 

756 IF HOURl>12 THEN HOUR1-HOUR1-12 
760 PRINT #1, "SPEAKFILE-" ; HELLO S 
770 PRINT #1, n S PEAKTEXT- » ; H0UR1 ; MINI ; B ." 

780 FOR L=l TO COUNT: ANS$=INKEY$ : IF ANS$<>*« THEN 790 ELSE NEXT L 
790 IF ANS$»"Y" THEN 870 
800 PRINT LOOP 

BIO IF LOOP>REPS THEN GOTO 820 ELSE 850 'PHONE HOSPITAL 
820 FLAGl«l:WHO$«"+ n :NUMB=HOSP:GOSUB 2000 
830 'PRINT "PATIENT WON'T RESPOND. .PHONE CALL MADE. " 
640 GOTO 1810 
850 LOOP-LOOP+1 : GOTO 750 
860 ' PATIENT FEELINGS 
870 LOOP-0 

880 PRINT #1, "SPEAXFIL£=FEEL.MSG« ^ 
40 890 FOR J>1 TO COUNT: FEEL$-INKEY$ : IF FEEL$<>" W THEN 900 ELSE NEXT L 
900 IF FEEL$= n O" OR FEEL$""F" OR FEEL$-"G" THEN 1010 
910 IF FE£L$— "B" OR FEEL$= n A n OR FEEL$="T n THEN GOTO 940 
920 IF LOOP>REPS THEN GOTO 1000 ELSE LOOP-LOOP*! 
930 GOTO 880 

94 0 ' NEGATIVE FEEL RESPONSE - CALL HOSPITAL AFTER TAKING VITALS? 
950 PRINT #1, »SPEAKFILE>FHONE.MSG« 
45 960 FOR L=l TO COUNT: PHON$«INKEY$ : IF PHON5<> n " THEN 97 0 ELSE NEXT L 
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5 970 IF FH0N$«"¥« THEN FLAG2-1 ELSE 1010 'SET PHONE FLAG 

980 PRINT #1, •SPEAKFILE-VITALS.MSG" 
990 GOTO 1010 

1000 FEEL$-"NO RESPONSE" 'NO FEELING RESPONSE 

1010 FEEL$— "NONE" 'RECORD FEELING * GO ON TO BP 

1020 ' 

1030 ' BEGIN BP/PULSE PROMPT ROUTINE 
10 1040 ' 

1050 PRINT fl, "SPEAKFILE-BP.KSG" 

1051 OUT *H308 r &Hl 'OPENS BP DRAWER 

1052 FOR A-l TO 200 :NEXT A 

1053 OUT *H308 f fcH3O ' TURN ON BP £ START LITE 

1060 PRINT #1, "SPEAXFIIE-FINGER.HSG" 

1061 A*«INP(tH30A) :IF A%<«PR£SSED% THEN 1062 ELSE 1061 
75 1062 PRINT "STARTING BP" :OUT &H309,&H2 

"■063 FOR B-l TO 3: FOR D=»l TO 8000:NEXT D:NEXT B * 1 TO 6~1 MIN 45 SEC 
. .60 * 
1170 ' 

1180 ' 

1190 OUT *H309,fcHl : GOSUB 4010 'VENT BP CUFF - BP SUB 

1195 OUT &H309,&HF :OUT «i308,£H0 'TURN BP OFF 
20 1200 PRINT #1, "SPEAXFILE-BPOFF.MSG" 'BP DONE 

1201 FOR J-l TO COUNT2 :NEXT J 

1209 'PRINT #1, "SPEAKFILE-CLOSE.MSG" 

1210 ' 

1220 ' TEMP PROMT ROUTINE 
1230 ' 

124 0 OUT &H308,&H2 * OPEN THERM DRAWER 
25 1241 FOR A=l TO 200 iNEXT A 

1242 OUT £H30B,&H50 'TURN ON LITES 
1250 PRINT #1, "SPEAKFILE-TEMF.MSG" 
1260 TLOOP-0 

1265 A*-INF(6H30A) :IF A%<-PRESSED% THEN 1270 ELSE 1265 

1266 PRINT "TEMP STARTED . " 

■•^70 FOR G-l TO COUNT2:NEXT G 'WAIT 30 SEC 
30 --80 ' MARKER 

1380 GOSUB 3010 'CALL SUB TO TAKE TEMP. 
1390 IF TLOOP-1 THEN GOTO 1260 
1395 TLOOP*0 

1400 PRINT #l f "SPEAXFILE-TEMPOFF.MSG" 

1401 'FOR J«l TO COUNT 'CHECK THAT DRAWER IS CLOSED 

1402 'DOOR%*INF(H3 00) 

35 1403 'IF DOOR%»PRESSED THEN GOTO 1440 

1404 'NEXT J 

1406 'IF TLOOP>REPS THEN GOTO 14 09 ELSE TLOOP-TLOOP+1 

1407 'GOTO 1400 

.1409 'PRINT fl r "SPEAXFILE»CLOSE•KSG ,, 
1410 ' 

1420 ' DISPENSE PILLS ROUTINE 
40 1430 ' 

1440 PRINT fl, "SPEAKFILE=MED.MSG n 

1450 OUT £H30S,&H8 'DROP PILL 

1451 FOR A-l TO 200 zNEXT A 

1452 OUT fcH308,£H0 

1453 FOR A-l TO 500 :NEXT A 

1454 OUT *H308,&H4 'OPEN PILL DRAWER 
45 1455 FOR A-l TO 200 :NEXT A 

1456 OUT £H308,£H80 

14 60 PRINT fl, n SPEAKFILE= PILLS . MSG" 
1461 FOR 1-1 TO COUNT: NEXT I 
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14 62 PRINT #1, "SPEAKFTLE-DIDPILL.MSG 

1463 FOR 1>1 TO COUNTi DID$-INKEY$ : IF DID$—"Y" THEN 1480 ELSE NEXT L 

1464 PRINT #1, "SFEAXFILE-DIDPILL2.MSG" 

1465 GOTO 1461 

1480 OUT AH308,*HO 'LITES OFF 
1490 ' PHONE CALL PROMPT ROUTINE 
1500 ' 

1510 IF FLAG2-0 AND FLAG3-0 AND FIAG4-0 AND FLAGS -0 AND FLAG 6-0 AND FIAG7»0 ANI 

1520 PRINT #1, "SPEAXFILE-CALLHOS.MSG" 

1530 WHO$-"+":NUMB=»HOSP:GOSUB 2000 

1540 GOTO 1730 'OFFER TO MAKE ANOTHER CALL 

1550 LOOP-0 

1560 PRINT #1, "SPEAKFILE-TALK.MSG W 

1570 FOR L-l TO COUNT: TAXX$-INKEY$ : IF TALK$<>"" THEN 1580 ELSE NEXT L 
1580 IF TALK$-"Y" THEN 1620 'PLACE PHONE CALL 

"90 IF TAI^$ a » B N n THEN 1800 'GO ON 
j. 600 IF LOOP>REPS THEN GOTO 1800 ELSE LOOP-LOO P+l 
1610 GOTO 1560 
1620 'SETUP PHONE CALL 
1630 LOOP-0 :NUMB»0 

164 0 PRINT fl, "SPEAKFILE=TALK2.MSG" 

1650 FOR L-l TO COUNT: WHO $»INXEY$ : IF WHO$<>«" THEN 1660 ELSE NEXT L 
1660 IF KHO$-"+" THEN NUMB-HOSP 

1670 IF WHO$=»"D" THEN NUMB~DOC 'DOCS PHONE NO. 
1680 IF WHO$«»M" THEN NUKB»MARY 'MARYS PHONE NO. 
1690 IF NUMB>0 THEN GOTO 1720 

1700 IF LOOP>REPS THEN 1730 ELSE LOOP- LOO P+l 
1710 GOTO. 1640 
1720 GOSUB 2000 
173 0 LOOP=»0 

1740 PRINT fl r "SFEAKFILE-'TAUO .MSG" 

1750 FOR 3>1 TO COUNT :ANOTH$»INXEY$: IF ANOT^o"" THEN 1760 ELSE NEXT L - 
1760 IF ANOTH$=»"Y" THEN GOTO 1620 
1770 IF ANOTH$-"N" THEN GOTO 1800 

80 IF LOOP>REPS THEN GOTO 1800 ELSE LOOP-LOOF+1 
1790 GOTO 1740 

1800 PRINT #1, "SPEAKFILE— QUIET -MSG" 

1810 CLOSE *l:GOTO 560 ' LOOP AROUND AGAIN 

1820 'END 

1B30 ' 

1840 ' 

1850 ' 

2000 'SUB TO PLACE PHONE CALL 
2005 ' 

2010 GOTO 2900 'SKIP PHONE CALL 
2020 OPEN "COM2:1200,N, 8,1" AS #2 
2030 PRINT #2, "ATDT" ?NUMB 
204 0 L00P=0:A$»"" 
2050 B$="" 

2060 B$-INFUT$ <1,#2) 

2070 IF (ASC(B$)<48) OR (ASC(B$) >122) THEN 2050 ELSE L00P=»L00P+1 

2080 IF L00P<9 THEN 2050 ELSE A$=A$+B$ 

2090 IF A$<>"CONNECT" THEN 20510 

2500 PRINT #2, CHR$(7) , CHR$<7), CHR$(7) 

2510 'PRINT #2, "STEVE NEEDS ATTENTION" 

2520 PRINT i2, "H.A.N. C. NO. 33 LOCATION NO. 12" 

2530 PRINT #2, "PHONE 111-555-1212" 

2540 PRINT #2, "BP : ■ ;BPS;V , ?BPD 

2550 PRINT #2, "PULSE : "?FULS 

2560 PRINT 42, "TEMPERATURE : " ?TEMP 
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2800 C LOSE #2 
2900 RETURN 
3000 ' 

3010 'TEMP ROUTINE 
3020 ' 

3030 'GOSUB 240 ' CALL ANALOG ASSEKB ROUTINE 

3040 'TEHP-Y 'GET TEMP FROM REG. Y 

3050 T-PIX (TEMP) :DEC«CXirr (10* (TEMP-FIX (TEMP))) /10 ' TRUNC/RODND TO TENTHS 
3060 T-T4-DEC 

3070 PRINT #1, "SFEAXTEXT-YOUR TEMPERATURE IS" ;T; "DEGREES, • 

3080 IP TEMP^TLOW AND TEMP <: THIGH THEN PRINT *1, *SPEAXFILE**TEMPOK.MSG M :TLOOP«0 : 
3090 IP TLDOP-1 THEN 3130 

3100 17 TEHP<TL0H THEN PRINT #1, w SPEAXFILE*TEMFLOW.MSG w 
3110 IF TEMP>THIGH THEN PRINT #1, «SPEAXFII*E»TEMPHI .HSG" 
3120 TLOOP-l: RETURN 'REPEAT TEMP MEASURE 

3130 'TEMP STILL OUT OP RANGE 
I 10 TLOOP-0 

3150 IF TEMP<TLOW THEN PRINT #1, "SPEAKFILE«TEMPLOW2 -MSG* : FLAG3~1: RETURN 
3160 IF TEMP>THIGH THEN PRINT #1, "SPEAKFILE-TEMPHI2 .MSG" : FLAG4=1: RETURN 
4000 ' 

4010 'BP/P ROUTINE 
4020 ' 

4030 PLOOP-0 

4040 'GOSUB 240 ' CALL ANALOG ASSEMB ROUTINE 

4050 'PULS-OC:BPS«V:BFD«W 'GET BLOOD PRESSURE AND PULSE FROM X,Y f W 

4060 PRINT #1, M SFEAKTEXT~YOUR PULSE IS»;PDLS?" AND YOUR BLOOD PRESSURE IS"; BPS 

4070 IF PU1S>FULSL0 AND PULS<PULSHI THEN PRINT #1, n S PEAKFI LE« PULS OK . MSG " ELSE 

4080 FLAG7~0:FIAG8-0:GOTO 4140 

4 090 IF PLOOPOO THEN 4130 

4100 IF PULS<FULSLO THEN PRINT 11, " SPEAKFILE= PULS LO. MSG" : FLAG7-1 
4110 IF FULS>PULSHI THEN PRINT #1, "SPEAKFILE-FULSHI .MSG" : FLAG8-1 
4120 PLOOP— PLOOP+ 1 * GOTO 4050 'REPEAT PULSE/ BP 
4130 'STILL OUT OF RANGE GO ON TO BP 
4140 'GO ON TO BP 

4150 IF (BPS>SYSL0 AND BPS<SYSHI) AND (BPD>DIL0 AND BPD<DIHI) THEN PRINT #1, "S 

4 j0 IF BPS<SYSL0 OR BPD<DILO THEN PRINT fl, "SPEAXFILE-BPLO.MSG" ELSE 4180 

4170 FLAG5-1: RETURN 

4180 'BP SHOULD BE HIGH 

4190 PRINT #1, "SPEAKFILE-BFHI.HSG" 

4200 FLAG6-1: RETURN 



Claims 

1 . An interactive assistance providing apparatus comprising: 
a housing; 

control means carried by said housing; 

means, carried by said housing and coupled to said controi means, for synthesizing audible sounds in 
response to commands from said control means; 

means, carried by said housing and coupled to said control means, for dispensing a deliverable product in 
response to commands from said control means; 

means actuated by said controi means for delivery of said dispensed product; 

means, carried by said housing and coupled to said control means for initiating selected diagnostic tests in 
accordance with a predetermined, prestored schedule; and 

means, coupled to said control means for receiving results of said selected tests with said control means 
including means for generating a reminder sequence of commands to said synthesizing means for 
producing an audible reminder message in response to a prestored schedule and for providing disepnsing 
commands to said dispensing means. 

2. An apparatus as in claim 1 including: 

means for generating a reminder sequence of commands to said synthesizing means for producing^ an 
audible diagnostic test initiation reminder message in response to said prestored schedule and for providing 
selected test initiation commands to said test initiation means. 

3. An apparatus as in claim 1 including means, carried by said housing and coupled to said control 
means, for moving said housing in a selected direction. 

4. An apparatus as in claim 3 including obstacle detecting means carried by said housing. 
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5. An apparatus as in claim 1 including means, coupled to said control means and carried by said 
housing, for recognizing at least selected audible words. 

6. An apparatus as in claim 5 wherein said recognizing means includes means for recognizing selected 
audible words spoken by at least two different individuals. 

s 7i An apparatus as in claim 5 including means for attempting to complete an audio telecommunications 

link with a remote location in response to selected recognized words. 

8. An apparatus as in claim 5 with said diagnostic tests selected from a group including at least blood 
pressure measurement; pulse rate measurement; and corporal body temperature measurement 

9. An apparatus as in claim 1 further including means for displaying selected information. 

70 10. An apparatus as in claim 1 including means, actuated by said control means for delivery of said 
selected diagnostic test implement for use. 

11. An apparatus as in claim 1 including means, carried by said housing and coupled to said control 
means, for detecting and recognizing at least a predetermined plurality of audible sounds. 

12. An apparatus as in claim 10 with said delivery means including electrically actuated release means 
75 for effecting delivery of said selected diagnostic test implement for use. 

13. An apparatus as in claim 10 including a moveable test implement supporting member. 

14. An apparatus as in claim 13 with said supporting member moveable from a first closed, to a 
second, delivery position. 

15. An apparatus as in claim 14 including biasing means for urging said supporting member from said 
20 first to said second position. 

16. An apparatus as in claim 1 with said dispensing means including a housing defining a deliverable 
product containing volume. 

17. An apparatus as in claim 16 with said delivery means supported, at least in part, adjacent said 
housing and including means for movement of a selected quantity of the deliverable product from a position 

25 adjacent said housing to a delivery position. 

18. An apparatus as in claim 1 with said control means including means for altering said predetermined, 
prestored schedule. 

19. An apparatus as in claim 1 including a plurality of moveable containers moveable from a first, 
closed, position to a second, open, position in response to electrical signals generated by said control 

30 means. 

20. An interactive system comprising: 
a housing; 

control means carried by said housing; 

means, carried by said housing and coupled to said control means, for detecting and recognizing at least a 
as predetermined plurality of audible sounds; 

means, carried by said housing arid coupled to sad control means, for synthesizing audible sounds in 
response to commands from said control means; 

means, carried by said housing and coupled to said control means for dispensing selected products in 
response to commands from said control means; 
40 means, carried by said housing and coupled to said control means for initiating selected diagnostic tests in 
accordance with a predetermined, prestored schedule; 

means, actuatable by said control means, for delivery of selected diagnostic test apparatus from a stored 
condition to a use condition; 

means, coupled to said control means for receiving results of said selected tests with said control means 
45 including means for generating a reminder sequence of commands to said synthesizing means for 
producing an audible reminder message in response to a prestored schedule and for then providing 
disepnsing commands to said dispensing means; 

means for moving said housing in response to commands from said control means; and 
obstacle detecting means, carried by said housing and coupled to said control means for providing 
so information as to the presence of obstacles to said moving housing. 

21. A system as in claim 20 including means for establishing a telecommunications path between the 
system and a remote location. 

22. A system as in claim 21 including means for providing a sequence of prestored diagnostically 
related information for transmission to the remote location. 

55 23. A system as in claim 21 including means for conducting a verbal conversation with the remote 
location using said telecommunications path. 

24. A system as in claim 20 including timing means, coupled to said control means, for proving an 
alarm indicium in reponse to a prestored schedule. 
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25. A system as in claim 20 with said initiating means including; 
means for determining temperature of a selected corporal body. 

26. A system as in claim 20 with said initiating means including: 
means for determining selected fluid pressures of a corporal body. 

27. A system as in claim 20 with said control means including a programmed computer. 

28. A system as in claim 10 including means actuatable by said control means for delivery of said 
dispensed product. 

29. A system as in claim 28 including reieasable and moveable means for supporting said dispensed 
product. 

30. An interactive assistance providing apparatus comprising; 
a housing; 

control means carried by said housing; 

means, carried by said housing and coupled to said control means, for synthesizing audible sounds in 
response to commands from said control means; 

means, carried by said housing and coupled to said control means, for dispensing medication in response 
to commands from said control means; 

means actuated by said control means for delivery of said dispensed medication; 

means, carried by said housing and coupled to said control means for initiating selected diagnostic tests in 
accordance with a predetermined, prestored schedule; and 

means, coupled to said control means for receiving results of said selected tests with said control means 
including means for generating a reminder sequence of commands to said synthesizing means for 
producing an audible medication taking reminder message in response to a prestored schedule and for 
providing disepnsing commands to said dispensing means. 

31. An apparatus as in claim 30 including means for detecting and recognizing at least a plurality of 
audible sounds. 



15 



EP 0 342 859 A2 

■3 t •* t 




BNSDOCiD: <EP 0342B59A2_I_> 



EP 0 342 859 A2 



Q 

O 

O 
—I 

m 



uj 
or 

ZD 
CO 
CO 
LU 

tr 
Cl- 



io 
id 



-4- 



LU 

o 



LU 




PHON 


SET 


LU 




TEL 


HANI 



2: to 

LU — I 
OLU 
>- > 
X LU 
O — I 



CL 
LU 



oo 

CNI 



OZ 
P O 3 




EP 0 342 859 A2 




BNSDOCID: <EP 0342859A2_I_> 




BNSDOCID: <EP 0342B59A2_|_> 



EP 0 342 859 A2 



SET UP 

VARIABLES &] 
LIMITS 







SYSTEM 
RESPONDS 
TO INTERRUPT 







'PROMPT FORA.NO 
USER NAME 




1 NO 




NOT 
RESPONDING 
CALL HELP 



NONE 



LOAD USER 
VOICE 
PROFILE 



PROMPT 
HOW DO YOU 
FEEL 



ANNOUNCE 

BLOOD 
PRESSURE 



JRN ON BLOOD 
PRESSURE 
LIGHT 120a &j 
/OPEN DRAWER 
12Aa 




0 




YES 



SET FLAG TO 
CALL DOCTOR 



r VERBAL PROMPT 
HO TAKE VITAL 
SIGNS 1st 



Fig. 11a 



BNSDOCID; <EP 0342859A2_I_> 



EP 0 342 859 A2 




PROMPT USER 
TO START 
AGAIN 



SPEAK 
RESULTS/ 
INTENT 





(VERBAL PROMPT/ 

TO PUT B.R 
/CUFF ON & START J 



TIMING 
COUNTER 



■IAS 
PATIENT 
RESPONDED. 

9 



CLOSE BLEED 
i VALVE & POWER j 
BP DEVICE 



READ/ANALYZE 
PULSE & B.R 



YES 



YES 




(5 



INCREMENT 
LOOP COUNT 




FLAG NO 
RESPONSE-GO 
ON TO TEMP 




Fig. 11b 



BNSDOCJD: <EP 0342859A2_I_> 



EP 0 342 859 A2 




SPEAK 

'B.P /PULSE 
RESULTS 



VENT B.PCUFF 
'& TURN OFF 
LIGHTS 



VERBALLY 
3 ROMPT FATIENT/ 
TO REMOVE/ 
/REPLACE CUFF 



(OPEN TEMP 
/DRAWER &TURr 
ON UGHTS 



VERBALLY 
'ROMPT PATIENT 
/TO PLACE TH 
IN MOUTH 




TIMING 
COUNTER 



INCREMENT 

LOOP 
COUNTER 




READ TEMP 



0 



Fig. 11c 



FLAG No 
RESPONSE -GO 
ON TO PHONE 



(5 



EP 0 342 859 A2 




VERBALLY 
PROMPT 
'PATIENT TO 
START AGAIN 



SPEAK 
RESULTS/ 
INTENT 



YES 





ANALYZE 
TEMP 




YES 




VERBALLY 
/PROMPT BMIENT/ 
TO REMOVE/ 
/REPLACE THERI* 



Fig. 11d 



TURN OFF 
LIGHTS 



BNSDOCID: <EP 0342859A2J_> 



EP 0 342 859 A2 



5 



DISPENSE 
PILLS INTO 
DRAWER 




BNSDOCID: <EP 0342859A2.J_> 



EP 0 342 859 A2 



100 



202- 



0 



CPU 
46 



0 



UNINTERUPTABLE 
POWER SUPPLY 



144 



Fig. 12 



200 



40a 



X 



PHONE 
LINES 



MODEM ^RJ11 
AUTO DIAL/ANS. 
W/ VOICE CHANNEL 



NE / 



PILL DISPENSER 



-48a 



r 



ICC 
Q 



INSTRUMENTATION 
BLOOD PRESSURE 
PULSE RATE 
*URINE ANALYSIS 
*BLOOD GAS 



•48b 



Q 
< 



SPEECH PROCESSOR 
VOICE RECOGN. 
VOICE SYNTH. 
VOICE RECORDING 



-36 



=0 



BULK STORAGE 
FLOPPY DISC 
HARD DISC 



-142 



DISPLAY 



14 



=0 



MAIN MEMORY 512K 
BATTERY BACKED 



206 



BNSDOCID: <EP 0342fi59A2_l_> 




EP 0 342 859 A2 



<d2 



ereo. 



U —.Cl 



cn 




BNSDOCID: <EP 0342B59A2_I_> 



EP 0 342 859 A2 



TO/FROM 
CPU , B4S 

12 



210 




U3 




0) 10 



27K 



u5 



026) 9 




U2 



-b 




U2 



W\r- 

2.7k 



vW- 



C32) 7 




no 




'LED^ 



VVV— c 

2.7k 



v 'LED 



S 1 ^ 




in 



1 y 

ft 




'LED 

f4) 4 



-WNr-i 

2.7k 



Ul 



ATSv s.- 



(2) ^ 



7k 





LED 
ft) 2 



vw— 
2.7k 



U1 



;39K 



'LED 
1 



vW-J 
2.7K. 



J1 P1 




Fig. 14a 



THIS PAGE BLANK (uspto) 




BNSDOCID: <EP 0342859A2TI_> 




BNSDOCID: <EP 0342859A2T!_> 




BNSDOC1D: <EP 0342859A2TI_> 



EP 0 342 S59 A2 



l 3 i > 

> * i < 

i N 1 ■ . 



SET UP 
VARIABLES & 
UMfTS 



SYSTEM 
RESPONDS 
TO INTERRUPT 




LOAD USER 

VOICE 
PROFILE 




BNSDOCID: <EP 0342859A2TL> 



EP 0 342 8E0 A2 



1 ■ 

p 1-1 



YES 




fVERBAL PROMPT 

TO PUT 8 R 
KUFFQN & START 



1 



READ/ANALYZE 
PULSE & B.P 




INCREMENT 
LOOP COUNT 




FLAG NO 
RESPONSE -GO 
ON TO TEMP 



5 



Fig. 11b 



BNSDOCID: <EP 0342659A2TI_> 



EP 0 342 QZB A2 




SPEAK 
fB& /PULSE 
RESULTS 



r VENT BPCUI 
'a TURN-OFF 
LIGHTS 



7 



VERBALLY 
PROMPT RMIENT/ 
REMOVE/ 
REPLACE CUFF 



'OPEN TEMP 
^DRAWER &1URf 
ON LIGHTS 



VERBALLY 
PROMPT RSTIENTj 

PLACE T\ 
IN MOUTH 




TIMING 
COUNTER 



READ TEMP 



* 1 v ^ 
1 i 

+ n 
m l 

>M 1 



1 *> 



INCREMENT 

LOOP 
COUNTER 




Fig, 11c 



FLAG No 
RESPONSE - GO 
ON TO PHONE 



EP 0 342 BBS A2 




REPORT 
RESULTS 



/ VERBALLY / 
/PROMPT FttTlENT/ 
/TO REMOVE/ / 
/REPLACE THERfrf 



/ TURN OFF 
/ LIGHTS 

Fig. lid 1 I 

(3 



BNSDOCID; <EP 0342859A2TI_> 



EP 0 342 BBS A2 



1 * ♦ > 



4 % 3 I 



DISPENSE 
PILLS INTX5 
DRAWER 



OPEN 
MEDICATION 
/"DRAW 8r TURN 
ON LIGHTS 




BNSDOCID: <EP 0342859A2TI_> 



EP 0 939 A2 



1 "I 
1 1 



200 



40a 



100. 



202— 



3 



CPU 
46 



4 



UN I NTERUP TA BLE 
POWER SUPPLY 



144 



T 



Fig. 12 



/ — n 



PHONE 
UNES 



MODEM RJ11 
AUTO DIAL/ANS. 
W/VDICE CHANNEL 



NE / 



SOLENOID DRVRS. 
PILL DISPENSER 




■46a 



I — N INSTRUMENTATION 

— ✓ B 



ST 



LDOD PRESSURE 
PULSE RATE 
♦URIIC ANALYSIS 
*BLOOD GAS 



■4fib 



< 



SPEECH PROCESSOR 
1 ^ VOICE RE COG N. 1 
VOICE SYNTH. 
VOfCE RECORDING 



■36 



BULK STORAGE 
FLOPPY DISC 
HARD DISC 



■142 



DISPLAY 



14 



MAIN MEMORY 5I2K 
BATTERY BACKED 



+ 



205 




BNSDOCID: <EP 0342B59A2TI_> 



JEP 0 342 BS9 A2 



> 



ii ■» * *• 



TO/ 
CPU 



+124. 



FROM 
84 S 



210 




(4) 




<2) 



1rpt> — l^^v-+ 




.U1 



39 K 



r 



J1P1 




»4 



>3 



*2 



*9 



>- 



480 



212 



214) 



J2 





ire 



us 



us 



.1/5 



us: 



LM- 



U4 



U4 



4,7k\£ 



-a-v 



100V 




4,7K ESS 



5 



\00K 




IOOK 
RCA 
47K 12j> 




4.7 K 



?0OK 




10OK 

BP* 



47K IfiO. 

— *vw- 




4.7k ra_ 



TOOK 




RCA 

47K jeb 




IOOK 



Fig, 14a 



■>14 



^12 



4s 



45 



^4 



43 



42! 



19 



BNSDOCID: <EP 0342859A2T1_> 



® 



Europaisches Patentamt 
European Patent Office 
Office eu rope en des brevets 



© Publication number: 



0 342 859 A3 



© 



EUROPEAN PATENT APPLICATION 



© Application number: 89304779.5 
© Date of filing: 11.05.89 



© int. CI. 5 : G06F 15/42 



© Priority: 12.05.88 US 194018 
02.06.88 US 201779 

© Date of publication of application: 
23.11.89 Bulletin 89/47 

© Designated Contracting States: 

AT CH DE ES FR GB GR IT LI NL SE 

© Date of deferred publication of the search report: 
11.03.92 Bulletin 92/11 



© Applicant: HEALTH TECH SERVICES 
CORPORATION 
255 Revere Drive Suite 120 
Northbrook lllinois(US) 



© 



Inventor: Kaufman, Stephen B. 
1939 Lewis Avenue 
Highland Park Illinois 60035(US) 
Inventor: Hyland, Shelly 
4619 Daisy 

Crystal Lake Illinois 6001 2(US) 

Inventor: Lesczynski, Michael A. 

17 Stonefield Place 

Honeoye Falls, New York 14472(US) 

Inventor: Bryant, Cal L. 

718 Morning Glory Lane 

Bartlett Illinois 60103(US) 



Representative: MacGregor, Gordon et al 
ERIC POTTER & CLARKSON St Mary's Court 
SL Mary's Gate 
Nottingham, NG1 1LE(GB) 



© Interactive patient assistance system. 



© A system is provided for interactively assisting a 
patient. The system includes a speech synthesizer 
and recognition unit coupled to a programmed com- 
puter. The computer can keep track of a medication 
and diagnostic testing schedule. The system also 
includes diagnostic testing equipment coupled to the 
computer along with medication dispensing equip- 
ment. In accordance with a predetermined schedule, 
the system verbally communicates with the patient, 



prompts the patient through the various steps neces- 
sary to carry out the diagnostic testing and further 
prompts patient at appropriate times for taking medi- 
cation. The medication is also provided in combina- 
tion with the verbal prompts. The system also pro- 
vides access to a telecommunications link in re- 
sponse to verbal requests of the patient and in one 
embodiment can move in a limited area adjacent the 
patient. 



CO 
< 

o 
m 
oo 

CM 

CO 



LU 



J PHONE LINES 



OUT 



VOCE 
SrNTHESJS/ 
RECOG UNIT 



AUOIO IN 



AUTOMATIC 
CBALEF UNIT 



16 c 



PROGRAMMABLE 
CONTROL 
COMPUTER 



PROGRAMMABLE 
CLOCK/ 
CALENDAR 

it 



DISPLAY . --16t» 



MEDICATION 
OUTPUTS 



TELEPHONE 
HAND SET 



MONITORING 
FUNCTION 
INPUTS 



[BLOOD I 
J PRESSURE | 

I OXYGFN f« 
1 LEVELS 1 



TEMP 



ULTRASONIC SYSTEM 



3-* 



-Fig. 3 



Rank Xerox (UK) Business Services 

BNSDOCIO; <EP 0342859A3_1_> 



J 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Application Number 



EP 89 30 4779 
Page 1 



Category 



Citation of document with indication, 
of relevant passages 



where appropriate. 



Relevant 

to i 



CLASSIFICATION OF THE 
APPLICATION ant. CL4 ) 



PROCEEDINGS OF THE 8TH ANNUAL SYMPOSIUM ON 
COMPUTER APPLICATION IN MEDICAL CARE; IEEE 
COMPUTER SOCIETY PRESS, WASHINGTON DC, US; 
4 November 1984, WASHINGTON DC, US; 
pages 886 - 891; 

SANDERS, S. J.; SHEPPARD, A. P. ; SPURLOCK, J . M. ; 
'MICROCOMPUTER CONTROLLED CARE SYSTEM FOR THE 
SEVERELY PHYSICALLY IMPAIRED 1 
* page 886. left column, line 4 - line 13 * 
left column, line 37 - line 45 * 
right column, line 1 - line 10 * 
right column, line 22 - line 35 * 
left column, line 8 - line 21 * 
left column, 1 1ne 35 - 1 1ne 40 * 
left column, line 60 - right column. 



1-33 



G06F15/42 



* page 886, 

* page 886, 

* page 886, 

* page 887, 

* page 887, 

* page 887, 
line 5 * 

* page 887, 
left column, 

* page 888, 
line 10 * 

* page 888, 



right column, Hne 52 - page 888, 
line 14 * 

left column, line 42 - right column, 
right column, 1 1ne 36 - 1 1 ne 45 * 



TECHNICAL FIELDS 
SEARCHED (lot. Q.4 ) 



PROCEEDINGS OF THE 10TH AMMUAL CONFERENCE ON 

REHAB I LI TAT ION TECHNOLOGY; RESNA ASS. ADV. 

REHABILITATION TECHN. 1987; 

19 June 1987, SAN DIEGO, CA, US; 

pages 796 - 798; 

LEES, D. ; CRIGLER, B. ; VANDERLOOS , M. ; LEIFER, L. J. 
'DESIGN OF THE SECOND GENERATION DESK-TOP 
ROBOTIC AID* 

* page 796, left column, line 1 - line 24 * 

* page 796, right column, line 22 - line 26 * 

* page 797, left column, 1 ine 19 - 1 1ne 22 * 

* page 797, right column, line 17 - line 21 * 



1-31 



G06F 



The present search report has been drawn up for all claims 



Plice ef «carch 
THE HAGUE 



D*e ml cMrJeUoe «f the mmrtk 

14 JANUARY 1992 



BARBA M. 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alon« 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : n on -writ ten disclosure 
P : intermediate document 



T : theory or principle underlying the Invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document dted In the application 
L : document dted for other reasons 

& : member of the same patent family, corresponding 
document 



BNSDOCID; <EP 0342859A3J_> 




European Patent 
Office 



EUROPEAN SEARCH REPORT 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Application Number 



EP 89 30 4779 
Page 2 



Category 



Citation of 



t with indication, where appropriate, 
of relevant passages 



Relevant 
to 



CLASSIFICATION OF THE 
APPLICATION ant. <X4 ) 



EP-A-0 253 520 (BUDDY SYSTEMS, INC. . ILLINOIS, US 
) 7 January 1988 



* page 2, line 29 - line 50 * 

* page 3, line 18 - line 46 * 

* page 4, line 35 - line 43 * 

* page 4, Una 53 - line 55 * 

* page 5. line 3 - line 5 * 

* page 5, Hne 25 - line 26 * 

* page 11, line 43 - line 47 * 

US-A-4 695 954 (R.J.ROSE; R.L.TRIMBLE) 22 
September 1987 



column 3, 
figure 1 



line 1 - line 35 * 



ELECTRONICS TIMES 

no. 284, 27 September 1984, 

pages 24 - 25; 

PETRQSKY.M. : • ROBOTS LEND AN HELPING HAND TO 
DISABLED 1 

line 5 - line 8 * 
line 15 - line 35 * 
Hne 50 - line 64 * 
line 31 - line 67 * 
line 17 - line 35 * 
line 2 - line 5 * 

line 51 * 



page 24, column 1, 

page 24, column 3, 

page 24, column 3, 

page 24, column 4, 

page 25, column 3, 

page 25, column 2, 

page 25, column 2, line 36 

page 24; figure 1 * 



-/- 



The present search report has been drawn up for all claims 



1.2. 

7-10. 12, 
18, 

20-27.30 



7.16.17. 
19,21. 
27-3D 



I. 3-6. 

II, 13, 
19,20, 
29,31 



TECHNICAL FIELDS 
SEARCHED (Int. a. 4 ) 



PIkb of L 

THE HAGUE 



D*a mi coaplcUsa of Un urd 

14 JANUARY 1992 



BARBA M. 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if tail en aloM 

Y : particularly relevant if combined with another 

document of tbc same category 
A : technological background 
O : non-written disdosurt 
P : intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document dted in the application 
L : document dted for other reasons 

A : member of the same patent family, corresponding 
document 



BNSDOCID: <EP 0342859A3_I_> 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Application Number 



EP 89 30 4779 
Page 3 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to ctaira 



CLASSIFICATION OF THE 
APPLICATION (lot. CL4 ) 



PROCEEDINGS OF THE 1978 IEEE CONFERENCE ON 
DECISION AND CONTROL; IEEE COMPUTER SOCIETY 
PRESS; 

10 January 1979, SAN 01 EGO, CA, US; 
pages 1423 - 1428; 

LEE.C.S.G.; CAMPBELL, J.; SARIDIS.G. : 1 VOICE 
CONTROLLED TRAINABLE MANIPULATORS WITH VISUAL 
FEEDBACK* 

* page 1423, left column, 

* page 1423, left column, 

* page 1424. left column, 

* page 1424, left column. 



I. 4-6. 

II. 20. 
30-31 



line 11 - line 15 * 
line 29 - line 33 * 
line 5 - line 18 * 
line 45 - line 67 * 



TECHNICAL FIELDS 
SEARCHED (Int. Q.4 ) 



The present search report has been drawn up for all claims 



Place of search 

THE HAGUE 



Dale «f coaaptcltoa mt tan uarca 

14 JANUARY 1992 



BARBA M. 



S 

o 

a. 
H 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant tf taken alone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : non-written disclosure 
P : in termed late document 



T : theory or principle underlying the invention 
E : earlier patent document, but published oc, or 

after tbe filing date 
D : document dted in tbe application 
L : document cited for other reasons 



: neolxr of tbe sam« patent family, corresponding 
document 



BNSDOCID: <EP 0342859A3J_> 



